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ABSTRACT 


Due to the recent trend of technologies to use the network-based systems, 
detecting them from threats become a crucial issue. Detecting unknown or 
modified attacks is one of the recent challenges in the field of intrusion 
detection system (IDS). In this research, a new algorithm called quantum 
multiverse optimization (QMVO) is investigated and combined with 
an artificial neural network (ANN) to develop advanced detection approaches 
for an IDS. QMVO algorithm depends on adopting a quantum representation 
of the quantum interference and operators in the multiverse optimization to 
obtain the optimal solution. The QMVO algorithm determining the neural 
network weights based on the kernel function, which can improve 
the accuracy and then optimize the training part of the artificial neural 


Quantum Computing network. It is demonstrated 99.98% accuracy with experimental results that 
Quantum Multiverse the proposed QMVO is significantly improved optimization compared with 
Optimization multiverse optimizer (MVO) algorithms. 
This is an open access article under the CC BY-SA license. 
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1. INTRODUCTION 

The increase in the number of local networks has led to the continuous development of Internet data 
and the availability of massive amounts of network data has promoted the development of information 
technology, which requires careful attention. As a result, this evolution, in turn, has increased the system's 
vulnerability to various threats [1]. Any intrusion can have catastrophic consequences. For example, personal 
data may be destroyed, corrupted or illegally accessed as a result of breaches of confidentiality. In addition, 
infringements of integrity can lead to alteration of personal data. Computer network security has become 
a promising tool for secure channels. One of the promising tools for detecting attacks is the intrusion 
detection system (IDS). Cybersecurity infrastructures use IDS as an essential component and protect systems 
and infrastructures against various threats. An intrusion detection system consists of data collection, data 
clearing and pre-processing, intrusion detection, reporting and reasonable action, which is an essential part of 
these attack detection processes [2]. High classification accuracy and a low false alarm rate are the two main 
characteristics of well-developed IDS, so it is extremely important to develop mechanisms for intrusion 
detection in view of the conviction that suspicious activities can be detected by taking measures to prevent 
further breeding of computer networks or systems [3]. 

Data classification has been studied extensively in many computer fields and up to now, 
the development of classification has achieved great achievements and many types of classified technology 
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and theory will continue to emerge. In the face of a lot of noisy, cluttered, nonlinear data, artificial neural 
network (ANN) not only helps to make high - quality modeling and complete training in the process of using 
large amounts of data, but also has a test mode set to evaluate the performance of ANN. 

ANNs are a form of machine learning algorithm inspired by the behavior of biological neurons in 
the brain and central nervous system, and use mathematical models to describe the architecture of biological 
neural networks to solve information processing problems. The ANN model compromises three layers: 
the input layer, the hidden layers and the output layer. The weights connecting the input layer to the hidden 
layer, as well as the bias values of the hidden layer, are randomly generated before the learning process. 
Only the weights connecting the hidden layer to the output layer are trained by the fast-linear regression. 
An example of a simple ANN with a single hidden layer is shown in Figure 1, where "I" is the input of the 
neural network and "W" is the weight given to each input. 


Hidden Laver 


Figure 1. Simple ANN with a single hidden layer 


Recently, researchers from all over the world have been improving the ANN according to different 
forecasting tasks and have obtained some satisfying results [4]. Nevertheless, the gradient-based learning 
algorithms are widely used to train traditional ANNs, which may result in some drawbacks such as 
the slow convergence speed, the local minimum, and the overfitting phenomenon. In order to solve 
the aforementioned problems, we focus our research on an improved machine learning algorithm based on 
neural networks with random weights and kernels (KNNRW). Recently, neural networks with random 
weights and kernels (KNNRW) [5] has been proposed by replacing the hidden nodes mapping with the kernel 
mapping. It does not need to determine the number of hidden nodes of KNNRW. 

In order to solve the above problems, we focus our research on an improved neural network with 
random weights and kernels (KNNRW) and proposed quantum multiverse optimization (QMVO) algorithm. 
In this research, the neural network algorithm is first improved by determining the neural network weights 
based on the kernel function, and then optimize the training part of the artificial neural network to develop 
advanced detection approach for IDS. 


2. BASICS AND BACKGROUND 

In the last years, bio-inspired computing has witnessed advances, popularity, and interest in different 
areas of sciences and engineering. However, there are still some problems remaining unsolved. Some of these 
are classifications methodology, parameters tuning, the gap between theoretical and practical parts, large- 
scale real-world applications, and finally the selection of the appropriate algorithm for specific problem [6]. 
The motivation of the hybrid algorithms to solve the optimization problem is based on No Free Lunch (NFL) 
theorem [7]. According to NFL theorem, no algorithm is able to solve all the optimization problems. 
Therefore, this topic of research is open until now. Thus, researchers make many efforts to improve 
the current optimization algorithms to solve different complex problems. Some of them used the benefits of 
quantum computing (QC) to solve these problems such as the speed, efficiency, and performance of 
evolutionary algorithms. QC is a new emerging mechanism in computer science and engineering and other 
disciplines. QC is a branch of mathematics that uses the specificities of quantum mechanics for data 
transformation and information processing, which stored in a two-state quantum bits or qubit. It has gained 
the interest of researchers in the last years in the fields such as quantum algorithms and quantum computers. 
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QC depends on some principles of quantum mechanics in which the smallest information unit is called 
the quantum bit or qubit. QC uses 0 and 1 for representing the two basic states. The main difference between 
bit and qubit is that the qubit can be in a state between 0 and one not only in a state of 0 or 1 as in 
the classical bit. In QC, the processing of the enormous number of quantum states is implemented in 
a parallel way simultaneously [8]. Therefore, many types of research have studied the theoretical and 
practical studies to merge quantum computing and evolutionary computation [9]. Some of these are quantum 
genetic algorithms [10], quantum inspired scatter search [9, 11], quantum differential algorithm [12], 
mining large databases [13], 0—1 optimization problem [14], knapsack problem [15], traveling salesman 
problem [16], engineering inverse problem [17] and other areas of applications as in Gottfried and Yan [18]. 

Currently, quantum inspired algorithms are used to solve many combinatorial optimization problems 
as proposed [19]. There are many hybridized quantum evolutionary algorithms proposed in the literature such 
as quantum inspired evolutionary algorithms [10], quantum inspired immune algorithm [20], quantum 
PSO [21]. Sun et al. [21], quantum inspired PSO employed a probability searching technique, and the search 
space is transferred from classical space to quantum, where the particles’ movement is similar to the ones 
with the quantum mechanics [22]. Quantum inspired evolutionary algorithms were introduced to solve the 
traveling salesman problem [23], where the crossover operation was per-formed based on the interference 
concept. Multiverse optimizer (MVO) is one of the bio-inspired algorithms [24]. The main inspiration of 
MVO is taken from multiverse theory in physics. It is based on three main concepts in cosmology. These 
concepts are a wormhole, white hole, and black hole. Like other evolutionary algorithms, MVO starts the 
optimization process by creating a population of solutions. In fact, this algorithm mimics the interaction 
between multiple universes through the wormhole, black hole, and white hole. The core idea of MVO came 
from the fact that larger universes tend to send objectives to smaller universes to reach a stable position. 
MVO has been used to solve many optimization problems. Nineteen unimodal/multimodal benchmark 
functions have been adopted to evaluate the performance of MVO [24]. Fariset et al. [25] used MVO to select 
the optimal feature subset. Moreover, they used it to optimize SVM parameters. Han and Kim [10], employed 
the MVO for training the multilayer perceptions neural network. Their approach was evaluated and 
benchmarked using nine different biomedical datasets selected from the UCI machine learning repository. To 
assess the performance of this algorithm, the obtained results are compared with five recent evolutionary 
meta-heuristic algorithms: particles warm optimization (PSO), genetic algorithm (GA), differential evolution 
(DE) algorithm, and cuckoo search (CS). These studies have been revealed that MVO algorithm is more 
efficient than the other algorithms, and it can obtain better results. However, MVO algorithm like most of the 
optimization algorithms suffers from low exploitation and convergence rate. Zouache and Moussaoui [15] 
proposed a hybrid algorithm based on using particles warm optimization (PSO) and multiverse optimization 
(MVO). They combine the exploitation capability of PSO and the exploration capabilities of MVO. The 
experimental results validate its effectiveness compared to standard PSO and MVO. There is always room for 
improvement and adaptation of an algorithm to solve a particular set of problems. 


3. MATHEMATICAL MODELING 

Neural networks with weights and kernels (KNNRW) have been proposed by introducing the kernel 
function mapping of SVM as the hidden node mapping of NNRW. The optimization problem of NNRW can 
be written as (1) 


1 C 

min Leyyrw = 3 llwil? + 5 viele ll? (1) 

h(x;) .W = ti = rave) = 1,..., N 

Where €; is the training error related to the ith training sample x;, C is the regularization coefficient, 
and h(x;) denotes the ith row of H. The corresponding dual optimization problem of (1) can be formulated 
as (2) 


1 C 
Lie ie = wI]? + m Dilligil? — int Ge) w — ti sy) (2) 


Where q; is the langrage multiplier with respect to the ith training sample x;. 
The corresponding Karush-Kuhn-Tucker (KKT) conditions are as follows 


OLDNNRW 


mew =0 > we ya, h(x)’ —w = Ha (3) 
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ð 
Pant — 0 3 .0;= Co ,tH=1,.,N (4) 
OL 
SRNR = 0 — h(x;). w-ti+ & =0,i=1,..,N (5) 


Substituting (3) and (4) into (5), the following equation can be obtained 
(<+HH")a=T (6) 
C 


Where / is an identity matrix. 
Considering (3) and (6), the weight w can be calculated as 


_ yt (tl rT\ t 
w=H (<+ HHT) T (7) 
Thus, the output function of NNRW can be written as 
i -1 
f(x) = h(x) H? (- i HHT ) T (8) 


It can be seen from (8) that the specific form of A(x) is not important as long as the dot product of 


HH" (or h(x)H") is known. As a result, if the hidden node mapping A(x) is unknown, we can define 
the kernel matrix of KNNRW as follows 


Onnrw = HH" : 
Onverwi = h(x;) i h(x;) = K(x; x; ) (9) 


Consequently, the output function can be rewritten accordingly as 
T 
[K (x, x1 )] 
|o 
f(x) = | | 


Lk G Xn) 


(- + T T (10) 


In order to further improvement of accuracy, we adjust and update the weights in ANN using 


the recently proposed Quantum multiverse optimization (QMVO) algorithm. In QMVO algorithm, each 
universe has a state depicted by wave function Y(y, t) with probability density function of universe position 
lw(y,t)|*. In quantum, the dynamic behavior of universe differs from the standard version of MVO. 
The updating position is mathematically formulated as follows 


V(y) = —Ad(y) (11) 


Where (y) is the Dirac delta function and k is a positive value. 
The universe wave function in delta potential is defined as follows: 





hz (12) 


Where m denotes the universe’s mass and h denotes the reduced plank constant. 
The particles (universes) are defined by the following (13) 


yi(t +1) = i a+ B- |Mbesti —yi(t)|-In(1/u) if1>0.5 


x — B-|Mbest; — yi(t)| -In(1/u) if /<0.5 (13) 


Where u and / are randomly initialized in interval [0, 1], 6 denotes the contraction—expansion 


coefficient. It is linearly decreased over iteration. The mathematical formula is defined as follows 


Int J Adv Appl Sci, Vol. 9, No. 1, March 2020: 27 — 33 


Int J Adv Appl Sci ISSN: 2252-8814 o 31 


0.5 < (MAaXiter — titer) 


B iter + 0.5 


(14) 


Where Max;ze, defined as the maximum number of iterations and iter denotes the current iteration 
number. Mbest is defined as the population’ mean best or global point. It is mathematically defined as follows 


MaxDim 
Mbest = — > Xo dim (t) 
dim=1 (15) 


Where M is the number of universes (population size), g is the best universe æ index among all 
universes in the search space, dim denotes the universe dimension and MaxDim is the maximum number of 
dimensions. Through this, the local attractor in order to guarantee the convergence speed of the QMVO is 
defined as follows 


o Fi čidim + 12 Xo dim 


ri +72 (16) 


Where rand r, are the random numbers in range [0, 1], Xiqim 1s the ith universe index in dimth 
dimensions of the hyperspace and Xg qim denotes the gth best universe position index of dimth dimensions. 
The whole algorithm steps of QMVO are presented at algorithm. 


Quantum Multi Verse Optimization Algorithm (QMVO) 
1: Randomly set the initial values of the universes’s positions (population size) M, dimensions 


MaxDim, lowerlbp and upper ubp boundaries, the maximum number of iterations MaXiter and the 
best universe Qj. 

2: SU=Sorted universes 

3: Normalize the fitness value (the inflation rate) of the universes M. 

4: Set iter: = 1. {Counter initialization}. 

5: repeat 

6: Calculate the fitness value (the inflation rate) of the universes. 

7: Check if the new universes positions go out of the search space boundaries and bring it back. 
8: for (i=l: i <= M) do 

0: Update Mbest and f using (14) and (15) 

10: Set black hole index to i. 

11: for (j =l: i <= size of the universe position) do= 

12: R,= random ([0, 1]) 

13: if R, <= NI ( y;) then 


14: White hole index = Roulette Wheel Selection(-NI); 
15: U (black hole index, 7) =SU (white hole index, j) 
16: end if 

17: R,= random ([0, 1J); 

18: if Rə < Wormhole probability existence then 

19: l = random ([0, 1]); 

20: u = random ([0, 1); 

21: if /<0.5 then 

ph y; (t+1)=a—. |M best; — y; (t)|. In(t/u); 
23 else 

24: y; (t+1)=&- pB. |M best; — y; (|. In(t/u); 
23: end if 

26: end if 

2T: end for 

28: end for 


29: Set iter = iter +1. {Iteration counter increasing} 
30: until (iter < MaXiter) . {Termination criteria satisfied}. 
31: Produce the best universe. 
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The training process is an important phase for the optimization of the ANN. In the ANN training, 
each individual represents all of the weights and biases of the ANN structure. The objectives of this process 
are to search for the synaptic weights of the ANN and to reduce the MSE, which represents the cost function 
of the ANN and achieve the highest classification and prediction accuracy. The training of the neural network 
is determined by the QMVO algorithm based on the weights and the error rate obtained is based on the 
following pseudo-code. 


: initialize all universe as input parameter 

: for i=/ until count of universe 

: calculate universe; MSE 

: if universe; MSE are the minimum vale in all MSE universe 
: neural network weight s is universe; 

: best universe is universe; 

: endif 

: endfor 

: output bet universe is weight neural network 


COM DA WHR DH RK NHR 


Based on this pseudo-code, all worlds are considered as inputs of the system first, then the values of 
these worlds are considered as weights of the neural network. The MSE value or the error of each neural 
network is calculated according to the weights of each universe. Accordingly, the world with the lowest MSE 
rate is considered as the weights of the final neural network. In this way, the neural network is trained at each 
stage of the QMVO algorithm. 


4. RESULTS AND DISCUSSION 

The proposed model was implemented and evaluated in MATLAB. In the QMVO+ANN training 
using the NSL-KDD dataset with number of iterations=100. The IDS was evaluated on several factors. 
The main factors included in this research are detection rate (DR), false alarm rate (FAR), and accuracy 
(ACC). In the literature, most of research works in the field of intrusion detection focused on the accuracy, 
the detection rate (DR), and false alarm rate (FAR). In this research, we have adopted the same metrics to 
evaluate the performance of our proposed approach. The experimental results in Figure 2 provides 
an evaluation of the performance of the ANN intrusion detection for the QMVO algorithm with 97.48 DR, 
0.03 FAR, and 99.98 ACC. The results show the potential applicability of QMVO with ANN for developing 
practical IDSs. 

Further-more, the comparisons of the performance results of the proposed ANN+QMVO and 
another model ANN+MVO dataset are shown in Figure 3. The proposed ANN+QMVO clearly performs 
the best in terms of ACC and DR. The data correctly classified by the proposed ANN+QMV6O are more than 
correctly classified by ANN+MVO. 


Combination of Optimized ANN and QMVO Comparison of ANN+MVO and ANN+QMVO 


WACC MOR G@FAR WACC WDR BFAR 


99.98 97.48 





ANN+QMVO 
ANN+QMVO 
WACC 99.98 
GOR 97.48 
@FAR 0.03 





Figure 2. Combination of ANN and QMVO Figure 3. Comparison of ANN+MVO 
and ANN+QMVO 


5. CONCLUSION 

There are various techniques of Artificial Neural Network, which can be applied to intrusion 
detection system. Each technique is suitable for some specific situation. QMVO is easy to implement, 
supervised learning artificial neural network. Number of the epochs required to train the network is high 
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as compare to the other ANN techniques. This research presents a new global optimization algorithm called 
quantum multiverse optimization (QMVO) with ANN and quantum behavior for solving the optimization 
problems. Therefore, the proposed method offers the best strong exploration and precise 
exploitation capabilities. 

In this research, the proposed QMVO algorithm was only implemented for solving optimization 
problems. Thus, our future work will concentrate on implementing the QMVO in (1) solving more complex 
optimization problems with different properties and (11) design conceptions for engineering, practical 
applications, and constrained problems. 
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